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COMMAND  AND  CONTROL  THEORY 


1 .  PROJECT  OBJECTIVES 


'The  main  goal  of  this  research  is  to  start  bridging  the  gap  between 
mathematical  theories  of  command  and  control  and  empirical  studies.  More 
specifically,  the  goal  is  to  develop  theories  on  the  one  hand  and  to  model 
experimental  paradigms  on  the  other,  so  that  realistic  problems  in  command 
and  control  (C2)  can  be  studied  prior  to  the  design  of  experiments  and  the 
collection  of  relevant  data. 

The  research  program  undertaken  for  this  project  has  three  main 
objectives: 

(a)  The  extension  of  a  mathematical  theory  of  C2  organizations  so 
that  it  can  be  used  to  design  an  experimental  program; 

(b)  The  further  development  of  an  analytical  methodology  for  measures 
of  effectiveness,  and 

(c)  The  investigation  of  organizational  architectures  for  distributed 
battle  management  (many  weapons  on  many  targets  resource 
allocation  problems). 


The  unifying  theme  of  this  research  is  the  concept  of  distributed 
information  processing  and  decisionmaking.  The  emphasis  is  on  the 
development  of  models  and  basic  analytical  tools  that  would  lead  to  the 
design  of  an  experimental  program  as  contrasted  to  ad  hoc  experimentation. 


The  project  draws  upon  and  contributes  to  the  theoretical  developments 
on  naval  distributed  tactical  decisionmaking  (DTDM)  being  pursued  in 
parallel  under  ONR  Contract  No.  N00014-84-K-0519 .  The  co-existense  of  the 
two  programs  has  made  it  possible  to  undertake  long-range,  basic  research 
on  fundamental  issues  and  problems  in  command  and  control. 


2.  STATEMENT  OF  WORK 


The  research  program  has  been  organized  into  five  tasks,  four  that 
address  the  research  objectives  and  a  fifth  that  addresses  the  question  of 
disseminating  the  results  of  this  project  both  directly  to  the  members  of 
the  Basic  Research  Group  of  the  Technical  Panel  on  C*  of  the  Joint 

Directors  of  Laboratories  and  to  the  C*  community  at  large  through 
publications  and  presentations. 

2.1  RESEARCH  TASKS 

TASK  1:  Development  of  Computer-Aided  Design  System 

1.1  Develop  the  specifications  for  the  Computer-Aided  Design 
System.  Specifically,  design  the  data  base,  the  architecture 
generator,  the  performance-workload  locus  module,  and  the 
analysis  and  evaluation  module.  The  system  should  be  able  to 
handle  a  generic  five  member,  three  echelon  organization. 

1.2  Implement  the  design  developed  in  Task  1.1.  Design  the 

graphics  module  to  be  used  in  presenting  the  performance- 
workload  locus  and  its  projections  as  well  as  the  loci 
obtained  from  the  analysis  and  evaluation  module. 

1.3  Design  and  implement  the  user  interface.  Use  the  Petri  Net 
formalism  for  the  specification  of  the  interactions  between 
organization  members  and  the  design  of  protocols. 

TASK  2:  Command  and  Control  Organization  Design  and  Evaluation 

2.1  Develop  and  implement  a  set  of  tasks,  as  well  as  sets  of 

information  processing  (situation  assessment)  and  decision¬ 
making  (response  selection)  algorithms  for  use  with  the 
decisionmaker  models .  These  tasks  and  algorithms  should  be 

appropriate  to  future  experimental  efforts . 
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2.2  Use  organizations  with  up  to  five  members  to  exercise  and  test 
the  CAD  system  developed  in  Task  1 . 

2.3  Analyze  and  evaluate  command  and  control  organizational 
architectures  using  the  CAD  system.  Begin  developing 
hypotheses  that  can  be  tested  through  experimental  efforts . 

2.4  Incorporate  in  the  design  system  and  in  the  analysis  module 
the  theoretical  results  obtained  from  parallel  research 
projects . 

TASK  3:  C*  Organizations  and  Architectures  for  Distributed  Battle 


Management 

3.1  Develop  a  unified  theory  for  complex  engagements  of  several 
weapons  against  several  targets.  Assume  imperfect  defensive 
weapons  systems  so  that  the  elemental  "one-on-one"  kill 
probability  is  non-unity.  Also  assume  imperfect  defensive 
surveillance  so  that  the  target/decoy  discrimination 
probability  is  non-unity. 

3 .2  Develop  several  "many-on-many"  engagement  strategies  and 
evaluate  their  impact  upon  decentralized  C*  system 
requirements  and  architectures.  Develop  the  necessary  tools 
so  as  to  design  distributed  C*  architectures  compatible  with 
the  engagement  strategies . 

3.3  Illustrate  the  tactical  doctrine  and  Ca  interface  requirements 
via  computer  simulations .  Develop  hypotheses  that  could  be 
tested  in  the  field. 


TASK  4 

4.1 

4.2 


4.3 

TASK  5 

5.1 


:  Measures  of  Effectiveness 


Conceptual  Development .  Develop  and  refine  the  concepts  and 
definitions  of  measures  of  effectiveness  (MOEs),  measures  of 
performance  (MOPs),  and  system/mis3ion  parameters.  Interpret 
the  concept  of  measure  of  force  effectiveness  (MOFE)  as  a 
global  effectiveness  measure  in  the  context  of  C*  systems. 

Implementation  of  the  Methodology.  Develop  a  quantitative 
framework  where  models  of  various  types  can  be  used  to 
estimate  measures  of  performance  (MOPs) .  Develop  analytical, 
computational  and  graphical  tools  for  measuring  effectiveness 
(MOEs) .  Begin  the  implementation  of  these  techniques  on  the 
same  workstation  used  for  Task  1  with  the  objective  of 
developing  a  system  based  on  MOE  evaluation  that  can  be  used 
as  an  aid  in  system  development  and  selection.  Note  that  many 
of  the  software  utilities  to  be  developed  are  common  to  Tasks 
1  and  4 . 

Implication  of  the  Methodology.  Illustrate  the  various 
conceptual  and  technical  developments  with  examples  drawn  from 
actual  or  planned  C1  systems.  Apply  the  methodology  to  an 
evolving  C1  system.  While  motivated  by  real  systems,  the 
applications  will  be  described  in  generic  terms. 

:  Information  Dissemination 


Participate  in  technical  sessions  of  the  Basic  Research  Group 
to  be  held  approximately  once  per  calendar  quarter. 


5.2  Present  the  research  results  at  technical  conferences  and 
meetings  and  publish  articles  in  archival  journals. 


3.  PROGRESS  REPORT 


During  this  six-month  period  (March  to  September  1987)  the  research 
effort  focused  on  the  integration  of  the  computational  and  graphical  tools 
to  be  used  in  the  design  of  organizations,  i.e.,  the  development  of  CAESAR 
(Computer-Aided  Evaluation  of  System  Architectures)  and  on  the  first 
experiment  involving  human  subjects. 

3 .1  Development  of  Computer-Aided  Design  System 

The  computer-aided  design  system  under  development,  which  was  named 
CAESAR  for  Computer-Aided  Evaluation  of  System  Architectures,  consists  of 
four  major  components: 

The  Architecture  Generator  which  constructs  feasible  organizational 
forms  using  the  Petri  Net  formalism. 

The  Analysis  and  Evaluation  Module  which  contains  algorithms  for  the 
analysis  of  organizational  architectures  and  the  computation  of 
Measures  of  Performance  (MOPs)  . 

The  Data  Base  which  is  used  to  store  the  results  of  the  analysis  (the 
MOPs)  of  organizational  architectures. 

The  Locus  module  which  contains  routines  that  construct  the 
Performance-Workload  locus  of  an  organizational  form  that  is  carrying 
out  a  given  task,  as  well  as  routines  that  compute  and  present 
graphically  selected  measures  of  effectiveness  (MOEs). 

The  structure  of  the  software  system  is  shown  in  Figure  1.  CAESAR 
incorporates  theoretical  and  computational  developments  obtained  over  a 
period  of  seven  years  through  more  than  ten  completed  theses  and  six  more 
in  progress.  Some  modules  are  being  developed  explicitly  under  this 
contract;  others  are  being  developed  with  support  by  the  Distributed 
Tactical  Decision  Making  initiative  of  the  Office  of  Naval  Research. 
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Figure  1 

CAESAR:  Computer  -  Aided  Evaluation  of  System  ARchitectures  v.  1.1,  9/87 


A  simplified  portable  version  of  CAESAR,  shown  in  Figure  2,  will  be 
demonstrated  on  September  29,  1987  at  the  annual  review  meeting  of  the  DTDM 
program  to  be  held  at  the  Naval  War  College,  Newport,  Rhode  Island.  The 
four  components  and  the  modules  they  contain  are  described  below: 

ARCHITECTURE  GENERATOR 

DMO  Gen .AT .  Program  that  generates  the  Petri  Nets  of  Decisionmaking 
Organizations  that  satisfy  a  set  of  structural  constraints,  as  well  as 
constraints  imposed  by  the  user.  The  algorithm  is  based  on  P.  Remy's 
thesis  (1986)  and  has  been  implemented  in  DOS  3.0  (IBM),  using  Turbo  Pascal 
3.01A  (Borland  International)  and  Screen  Sculptor  (Software  Bottling 
Company.  Status:  Program  operational  (6/87)  . 

DMO  Des.AT.  Interactive  graphics  program  for  the  construction  of  the  Petri 
Nets  of  arbitrary  organizational  architectures.  It  can  be  used  to  create 
and  store  subsystems  and  to  combine  them  to  form  large  organizational 
structures.  This  program,  developed  by  I.  Kyratzoglou,  also  creates  the 
analytical  description  of  the  Petri  Nets.  It  has  been  implemented  in  DOS 
3.0,  Professional  Fortran,  Graphics  Tool  Kit,  and  Graphic  Kernel  System, 
all  from  IBM.  Status:  Program  Operational  (8/87) . 

DMO  Des .Mac .  Interactive  graphics  program  for  the  construction  of  the 
Petri  Nets  of  arbitrary  organizations.  It  can  be  used  to  design 
organizations  of  arbitrary  size  through  the  use  of  nested  subnets.  Program 
developed  by  J.  L.  Grevet  and  L.  Jandura  for  the  Apple  Macintosh  Plus  using 
the  Design  Open  Architecture  System  (Meta  Software  Corp.).  The  program 
creates  the  analytical  description  of  the  Petri  Net,  as  well  as  stores 
functions  and  attributes  represented  by  the  transitions,  places,  and 
connectors.  This  program  is  being  enhanced  on  a  continuous  basis.  Status: 
Program  operational . 

MacLink  (Datavlz) .  Commercial  software  for  converting  and  transmitting 
files  between  the  DOS  machines  and  the  Macintosh.  Status:  MacLink  has  been 
installed  and  is  operational. 
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Incidence  Matrix/Attributes.  Standard  form  for  the  analytical  description 
of  Petri  Nets .  The  files  contain  the  incidence  matrix  or  flow  matrix  of 
the  Petri  Net  and  the  attributes  and  functions  associated  with  the  elements 
of  the  net.  Status:  Standard  version  of  incidence  matrix  has  been 
implemented.  Operational  (7/87) 

ANALYSIS  AND  EVALUATION  NODDLE 


Matrix  Conversion.  Simple  algorithm  that  transforms  the  incidence  matrix 
into  the  interconnection  matrix  used  in  Jin's  algorithm  (1985)  .  Algorithm 
in  Turbo  Pascal  3.01A.  Status:  Algorithm  is  operational. 

Paths .  Algorithm  developed  by  Jin  in  her  thesis  (1985)  that  determines  all 
the  simple  paths  and  then  constructs  the  concurrent  paths  in  an 
organizational  architecture.  This  is  an  efficient  algorithm  that  obtains 
the  answers  by  scanning  the  interconnection  matrix .  Algorithm  in  Turbo 
Pascal  3.01A.  Status:  Program  is  operational. 

Delay.  Simple  algorithm  that  calculates  path  delays  and  expected  delay 
when  processing  delays  are  constant.  Algorithm  in  Turbo  Pascal  3.01A. 
Status:  Algorithm  is  operational. 

Del  Com.  Algorithm  developed  by  Andreadakis  that  calculates  measures  of 
timeliness  when  the  processing  delays  are  described  by  beta  distributions. 
It  also  accounts  for  the  presence  of  jamming  and  its  effect  on  timeliness. 
Algorithm  in  Turbo  Pascal  3.01A.  Status:  Problem  specific  version 
operational . 

Res  Con.  Algorithm  developed  by  Hillion  in  his  thesis  that  calculates  the 
maximum  throughput  in  a  Timed  Event  Graph,  a  special  class  of  Petri  Nets. 
It  also  determines  the  optimal  shedule  in  the  presence  of  resource  and  time 
constraints .  The  procedure  incorporates  an  algorithm  proposed  by  Martinez 
and  Silva  for  determining  simple  paths  through  the  calculation  of  s- 
invariants.  Status:  Independent  version  of  algorithm  is  operational; 
integrated  version  in  workstation  is  also  operational  (6/87)  . 
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PW  Comp  3 .  Algorithm  for  the  computation  of  a  three-person  organization’s 
performance  measure  J  (Accuracy)  and  the  workload  (G)  of  each  one  of  the 
decisionmakers .  The  algorithm  computes  the  accuracy  of  the  response  and 
the  workload  for  each  admissible  decision  strategy.  This  version  was 
developed  by  Andreadakis  in  Turbo  Pascal.  Status:  Program  is  operational. 

PW  Comp5 .  A  variant  of  PW  Comp  3,  but  for  a  five-person  organization 
modeling  the  ship  control  party  of  a  submarine.  Algorithm  developed  by 
Weingaertner  as  part  of  his  thesis  (1986).  Implemented  in  Turbo  Pascal. 
Status:  Program  is  operational  (1/87). 

DATA  BASE  HOPPLE 

LOCUS  Data  File .  Data  file  in  which  the  results  from  the  evaluation  of  a 
decisionmaking  organization  (i.e.,  the  MOPs)  are  stored.  The  file,  as 
currently  structured,  can  accommodate  five  measures  of  performance  - 
accuracy,  timeliness,  and  workload  for  three  persons.  It  also  contains 
four  indices  that  specify  the  decision  strategy  associated  with  each 
record.  Development  of  a  general  structure  that  can  hold  an  arbitrary 
number  of  MOPs  is  limited  by  the  memory  constraints  of  the  IBM  PC/AT.  The 
same  data  structure  is  used  to  store  the  data  files  used  in  the 
determination  of  measures  of  effectiveness.  Status:  The  five  MOP  version 
is  operational . 

LOCUS  MODULE 

LOCUS .  Graphics  plotting  program  that  generates  two  or  three  dimensional 
loci  or  two  and  three-dimensional  projections  of  higher  dimensional  loci . 
This  is  the  basic  program  used  to  construct  the  Performance-Workload  locus 
of  an  organization.  Basic  version  developed  by  Andreadakis  and  Bohner  and 
described  in  latter’s  thesis  (1986).  Status:  Version  using  professional 
graphics  controller  is  operational.  Revised  transportable  version  adhering 
to  the  VDI  standard  and  with  improved  user  interface  is  also  operational . 
This  version  can  handle  up  to  five  Decisionmakers. 


ISO  Data.  Algorithm  for  obtaining  some  measures  of  effectiveness  from  the 
measures  of  performance  stored  in  the  Locus  Data  file.  Specifically,  it 
finds  isoquants:  e.g.,  locus  of  constant  accuracy,  or  constant  workload. 
Status:  New  version  for  microcomputers  has  been  implemented  by  Azzola  on 
the  basis  of  a  design  by  Weingaertner .  The  VDI  version  is  operational. 

IHPOT/ OUTPUT 

Output.  By  adopting  the  Virtual  Device  Interface  (VDI)  standard  and  the 
Enhanced  Graphics  standard,  it  became  possible  to  develop  a  version  of  the 
CAESAR  software  that  is  transportable  to  other  IBM  PC  ATs  or  compatibles 
and  to  drive  a  wide  variety  of  output  devices.  The  VDI  version  is  now 
operational  and  can  drive  various  monitors,  printers,  and  plotters. 

Input:  A  uniform  user  interface  with  windowing  capability  is  needed  to 
make  the  system  useable  by  analysts  and  designers.  Commercially  available 
software  are  being  investigated  to  select  the  most  appropriate  one.  In  the 
meantime,  a  workable  user  interface  has  been  developed. 

The  effort  in  the  following  months  will  be  focused  on  investigating 
further  the  modules  shown  on  Figure  2  and  begin  the  integration  of  the 
remaining  modules  shown  on  Figure  1.  More  modules  will  be  added  as  new 
research  results  are  obtained . 

3  .2  Organizational  Designs 

3.2.1  Experimental  Investigation  of  the  Bounded  Rationality  Constraint 

A  simplified  air  defense  task  was  used  to  establish  experimentally  the 
existence  of  the  bounded  rationality  constraint.  This  constraint  is 
defined  as  a  point  value  and  expressed  in  terms  of  a  bit  rate  of  processing 
using  the  information  theoretic  surrogate  for  workload  developed  by 
Boettcher  and  Levis .  If  such  a  point  were  found  to  exist  for  a  sufficient 
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proportion  of  the  experimental  subjects,  and  if  the  point  were  sufficiently 
stable  within  individuals,  then  the  experimental  data  would  have  provided 
specific  parameter  values  needed  for  the  analytical  evaluation  of 
alternative  organizational  architectures. 

The  experimental  design  was  implemented  on  an  IBM  PC/AT;  The 
experiment  was  designed  so  that  it  can  be  transportable  and  can  be  carried 
out  on  any  IBM  PC/AT  or  compatible  machine.  At  MIT,  some  of  the  subjects 
used  the  AT  while  some  used  a  Compaq  Deskpro  Model  II  machine.  Analytical 
and  empirical  techniques  were  used  to  determine  appropriate  initial 
settings  of  the  experimental  parameters .  The  experimental  set-up  was 
refined  following  pilot  experimentation. 

All  stimulus  presentation  and  data  collection/reduction  was  controlled 
by  the  personel  computer.  Incomming  threats  were  displayed  on  a  simplified 
radar  screen  and  subjects  attempted  to  select  the  threat  with  the  earliest 
time  of  arrival.  Time  pressure  was  varied  incrementally.  The  minimum  and 
maximum  task  interarrival  times  differed  by  roughly  a  factor  of  three.  A 
clock  face  and  second  hand  beside  the  radar  screen  indicated  the  total 
window  of  opportunity  as  well  as  the  time  remaining. 

The  experiment  was  executed  with  subject  from  the  MIT  community  in  the 
spring  of  1987.  The  results  were  analyzed  in  May  and  presented,  for  the 
first  time,  at  the  1987  Symposium  on  C*  Research.  A  technical  paper  that 
describes  the  experimental  procedure  and  summarizes  the  results  is  appended 
to  this  report. 

This  particular  task  is  now  being  continued  along  two  directions . 
First,  the  analytical  model  of  the  experiment  is  being  used  to  analyze  the 
experimental  findings.  Second,  the  experience  obtained  is  being  used  to 
design  the  first  multi-person  experiment . 
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3.2.2  Modeling  and  Evaluation  of  Expert  Systems  in  Decisionmaking 
Organizations 

A  new  research  task  was  initiated  in  February  1987  by  Didier  M.  Perdu 
under  the  supervision  of  Dr.  A.  H.  Levis.  In  previous  work  (Chyen,  1984), 
the  effect  of  computational  decision  aids  (such  as  preprocessors  of 
incomming  data)  on  an  organization's  performance  was  investigated. 
However,  the  intensive  efforts  to  develop  and  implement  decision  aids  that 
perform  symbolic  manipulations  and  incorporate  expert  systems  have  raised 
the  question  of  how  they  will  affect  the  decisionmaking  in  C* 
organizations . 


$ 


In  this  project,  Petri  Nets  are  used  to  develop  models  of  symbolic 
computation  that  can  then  be  interconnected  to  represent  a  decision  aid  of 
the  type  curently  in  development,  the  consultant  expert  system. 


The  first  stage  of  this  effort  is  expected  to  be  completed  by  December 


1987. 


3.2.3  Structural  Properties  of  Organizational  Archiectures 

Pascal  Remy's  thesis  left  a  number  of  questions  open,  as  regards  the 
combinatorial  structure  of  organizational  architectures  modeled  by  Petri 
Nets.  Joseph  S.  Oliveira  will  examine  the  discrete  structural  aspects  of 
organizational  architectures  with  the  primary  goal  being  the  identification 
of  an  architecture's  combinatorial  invariants.  The  mathematical  conjecture 
is  that  the  order  structure  of  an  organizational  architectures,  as 
determined  by  its  operational  constraints,  allows  that  architecture  to  be 
enumeratively  classified  as  a  Matroid. 

The  combinatorial  invariants  of  a  Matroid  can  be  equated  with  a 
greedold.  Greedoid  invariants  explicitly  determine  optimization 
algorithms.  These  algorithms  are  then  employed  to  design  and  reorganize 
decisionmaking  organizations. 


.vj 
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This  task,  supervised  by  Dr.  A.  H.  Levis,  is  expected  to  provide  the 
theoretical  basis  for  classifying  admissible  organizational  forms  and  for 
modifying  designs  while  maintaining  the  desired  properties. 

3.3  C*  Organizations  and  Architectures  for  Distributed  Battle  Management 


Project  Objective:  The  long-range  goal  of  this  research  is  to 
understand  basic  issues  associated  with  Battle  Management/C3(BM/C3) 
architectures  associated  with  many  weapons  engaging  several  targets.  The 
defensive  weapons  are  assumed  imperfect,  and  the  targets  may  have  a  finite 
probability  of  being  decoys.  Thus,  the  problem  is  one  of  wise  Wespon-to- 
Target  (WTA)  assignment  strategies,  and  their  interface  with  other  BM/C3 
functions.  We  also  seek  the  evaluation  of  centralized,  decentralized,  and 
distributed  BM/C3  architectures  that  support  such  "taany-on-many" 
engagements . 

Problem  Definition:  The  major  emphasis  of  the  research  to  date  has 
been  in  the  area  of  problem  definition.  We  have  studied  the  problem  of 
optimizing  the  Weapon-to-Target  (WTA)  function  which  i3  at  the  heart  of  the 
"taany-on-many"  BM/C3  problem.  Several  formulation  of  the  problem  are 
possible.  Suppose  that  we  have  a  total  of  M  weapons  which  we  are  willing 
to  commit  against  a  total  of  N  targets.  At  the  most  general  level,  the 
effectiveness  of  each  weapon  can  be  different  against  each  target;  this  can 
be  quantified  by  having  a  different  kill  probability  Pjj  for  weapon  j 
assigned  against  target  i  ( j=l ,2, . . . ,M;  i=l ,2, . . .  ,N) .  The  WTA  function 
should  allocate  the  right  weapons  against  the  correct  targets  so  as  to 
minimize  some  cost  function. 


The  simplest  cost  function  is  leakage,  i.e.,  the  expected  number  of 
surving  targets.  Thus,  if  we  adopt  an  optimization  framework  we  wish  to 
minimize  the  leakage  L  which  is  given  by 


by  selecting  optimally  the  M.N  allocation  decision  variables  x^,  each  of 
which  is  either  0  or  1.  Thus,  *  1  if  the  j-th  weapon  is  assigned  to 
the  i-th  target  and  0  otherwise  and 

N 

XiJ  =  1  .  j  =  1.2, ...,M  (2) 
i=l 

which  simply  states  that  each  weapon  can  only  engage  a  single  target . 

The  solution  of  such  optimization  problems  for  the  WTA  function  is 
very  difficult,  because  it  has  a  strong  combinatorial  flavor;  in  fact,  it 
has  been  proven  to  be  NP-complete  by  Lloyd  and  Witsenhausen  in  1986,  Part 
of  the  complexity  relates  to  the  fact  that  the  kill  probabilities  p^  are 
different.  If  the  kill  probabilities  are  the  same,  i.e.,  Pjj=P  for  all  i 
and  j,  then  the  optimal  solution  (to  minimize  the  leakage)  is  easy  and  it 
requires  the  maximally  uniform  assignment  of  the  weapons  among  the  targets . 
The  problem  is  inherently  hard  even  in  the  special  case  that  the  kill 
probabilities  depend  only  on  the  weapons  but  not  the  targets,  i.e.,  p^  is 
independent  of  i . 

More  realistic  versions  of  this  problem  can  be  formulated  in  a  similar 
manner.  For  example,  each  target  indexed  by  i=l,2,...,N  can  be  assigned  a 
value  of  reflecting  the  importance  of  that  specific  target  to  the 
defense.  In  this  case,  the  defense  may  wish  to  minimize  the  expected  total 
surviving  value  associated  with  all  targets,  i.e.,  minimize  the  cost 
function 
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N  M 

c  ■  E'.n  <i-pijxu)  u) 

i=l  j=l 

again  by  selecting  optimally  the  M.N  allocation  decision  variables  x^j, 
subject  to  the  constraints  of  Eq.  (2)  . 

Another,  still  more  complicated,  problem  couples  the  WTA  problem  to 
that  of  preferential  defense.  In  this  framework  we  explicitly  take  into 

account  the  value  of  the  defense  assets .  So  let  us  suppose  that  the 

defense  wishes  to  protect  a  total  of  Q  assets,  indexed  by  q=l,2,...,Q,  and 
that  each  asset  has  a  value  denoted  by  D^.  Each  one  of  the  defense  assets 
can  be  attacked  by  one  or  more  enemy  targets.  Let  nqi  denote  the 

probability  that  the  i-th  target  can  kill  the  q-th  asset .  Note  that  the 
nqi  captures  such  important  attributes  a3  target  yield,  asset  hardness, 
targeting  accuracy  etc.  In  this  case  we  can  form  a  utility  function  which 
the  defense  wishes  to  maximize.  This  utility  function  takes  the  form 

Q  N  M 

u  -  e  dq  n  <i_v  n  “-’uv1  u> 

q=l  i=l  j=l 

The  above  formulation  allows  for  optimal  selective  defense  of  the  defensive 
assets .  It  may  be  worthwhile  to  leave  a  low-value  overtargeted  defense 
asset  undefended  in  order  to  direct  the  defensive  weapons  against  other 
targets . 

Description  of  Recent  Progress .  This  research  is  being  carried  out  by 
two  doctoral  students,  Mr.  J.  Walton  and  Mr.  P.  Hossein,  under  the 
supervision  of  Prof.  M.  Athans.  Mr.  Walton  joined  the  project  in  June 

1986,  while  Mr.  Hossein  joined  the  project  in  January  1987.  Both  students 

are  working  on  research  which  will  constitute  their  Ph.D.  thesis  topics  in 

this  area.  Most  of  the  recent  effort  has  been  in  comparing  the  performance 


of  different  computational  algorithms  for  solving  the  centralized  WTA 
problem.  We  are  also  analyzing  the  dynbamic  aspects  of  the  problem  in  the 
integration  of  the  overall  WTA  problem  with  shoot-look-shoot  strategies;  a 
stochastic  dynamic  programming  framework  is  being  used. 

Eventually  we  plan  to  address  several  questions  which  relate  to  the 
distributed  implementation  of  the  WTA  function,  and  understand  the 
following  types  of  issues : 

1.  Optimal  weapon  resource  utilization  deteriorates  with  increased 
distribution;  however,  such  degradation  will  be  strongly  dependent 
upon  the  effectiveness  of  one-on-one  engagements  (the  kill 
probabilities  p^  j  defined  above) . 

What  are  the  tradeoffs?  How  do  we  quantify  the  performance 
deterioration  associated  with  subopimal  WTA  algorithms?  Are  these 
classes  of  suboptimal  algorithms  which  are  more  suitable  for 
distributed  implementation? 

2.  The  overall  vulnerability  of  the  BM/C3  functions  will  reduce  a3  the 
degree  of  its  distribution  increases.  How  do  we  quantify  performance? 

3 .  The  communications  requirements  for  coordination  will  increase  as  we 
distribute  the  BM/C3  functions  more  and  more.  How  do  we  quantify 
these  tradeoffs  in  a  reasonable  manner? 

4.  The  complexity  of  the  coordination  strategies  will  increase  as  the 
degree  of  distribution  increases.  What  are  quantitative  tradeoffs 
between  performance  and  complexity?  How  do  we  handle  the  delay  in 
executing  a  local  BM/C3  function  (which  will  decrease  in  distributed 
architectures,  simply  because  each  subfunction  will  have  to  handle 
fewer  targets  and  weapons) . 


5.  To  what  extend  the  improvement  in  survivability  and  reduced  delays  are 

counterbalanced  by  increases  in  communication/ coordination  and 

resource  misutilization  ? 

Documentation:  No  formal  documentation  exists  as  yet. 

4 .  RESEARCH  PERSONNEL 

A  number  of  changes  in  the  staffing  of  this  project  took  place  in  this 
period . 

Dr.  Jeff  T.  Casey,  Research  Scientist  at  the  Laboratory,  resigned  to 
accept  a  position  on  the  faculty  of  the  State  University  of  New  York  at 
Stonybrook.  He  completed  his  part  of  the  experiment  and  the  associated 
documentation.  No  plans  are  being  made  to  find  a  replacement  in  the  near 
future.  The  experimental  program  has  been  initiated  and  will  be  continued 
as  originally  planned;  outside  consultants  will  be  sought  a3  the  need 
arises . 

Mr.  John  Kyratzoglou  completed  his  thesis  work  and  graduated. 

Professor  Amedeo  Odoni,  co-director  of  the  Operations  Research  Center 
at  MIT,  has  joined  the  research  team  (at  no  cost);  he  and  Dr.  Levis  will 
co-supervise  a  Ph.D.  student  who  will  address  some  dynamical  aspects  of  C* 
organizations.  This  student  is  Ms.  Susan  A.  Hall  who  had  been  a  graduate 
research  assistant  to  Dr.  Levis  in  1981-2  and  had  looked  at  the  question  of 
memory  in  C*  organization  (MS  Thesis). 

Mr.  Joseph  Oliveira,  Ph.D.  candidate  at  the  MIT  Department  of 
Mathematics,  also  joined  the  research  group  as  a  graduate  research 
assistant.  He  will  be  looking  at  ways  of  classifying  organizations  so  that 
we  can  relate  in  a  prescriptive  manner  structure  to  properties. 


Dr.  Alexander  H.  Levis,  Principal  Investigator 

Professor  Michael  Athans 

Professor  Amedeo  Odoni  (as  of  9/1/87) 

Dr.  Jeff  T.  Casey  (up  to  8/31/87) 

Ms.  Susan  A.  Hall  Research  Assistant  (Ph.D.  Candidate)  (as  of  9/1/87) 

Mr.  Patrick  Hossein  Research  Assistant  (Ph.D.  Candidate) 

Mr.  John  Kyratzoglou  Research  Assistant  (ME  Candidate)  (up  to  8/31/87) 

Mr.  Joseph  Oliveira  Research  Assistant  (Ph.D.  Candidate)  (as  of  9/1/87) 

Mr.  Didier  Perdu  Research  Assistant  (MS  Candidate) 

Mr.  James  Walton  Research  Assistant  (Ph.D.  Candidate) 

5.0  INFORMATION  DISSEMINATION 

The  following  documents  were  issued  as  Laboratory  Technical  Reports  or 
as  Technical  Papers.  There  were  submitted  to  ONR,  to  the  Basic  Research 
Group  of  the  JDL  Panel  on  C1 .  and  to  the  distribution  list  specified  in  the 
contract.  Some  aspects  of  the  work  contained  in  these  reports  were  supported 
by  other  related  projects,  such  as  the  one  from  the  Office  of  Naval  Research 
on  Distributed  Tactical  Decisionmaking  (N00014-84-K-0519) . 


5 .1  Theses/Technical  Papers 


1.  C.  M.  Bohner,  "Computer  Graphics  for  System  Effectiveness  Analysis," 
LIDS-TH-1573 ,  S.M.  Thesis,  Laboratory  for  Information  and  Decision 
Systems,  MIT,  Cambridge,  MA  July  1986. 

2.  P.J.  F.  Martin,  "Large  Scale  C*  Systems:  Experimental  Design  and  System 
Improvement,"  LIDS-TH-1580,  S.M.  Thesis,  Laboratory  for  Information  and 
Decision  Systems,  MIT,  Cambridge,  MA  August  1986. 

3.  H.  P.  Hillion,  "Performance  Evaluation  of  Decisionmaking  Organizations 
Using  Timed  Petri  Nets,"  LIDS-TH-1590,  S.M.  Thesis,  Laboratory  for 
Information  and  Decision  Systems,  MIT,  Cambridge,  MA  September  1986. 

4.  S.  T.  Weingaertner ,  "A  Model  of  Submarine  Emergency  Decisionmaking  and 
Decision  Aiding,"  LIDS-TH-1612,  S.  M.  Thesis,  Laboratory  for  Information 
and  Decision  Systems,  MIT,  Cambridge,  MA  September  1986. 


5.  P.  A.  Remy,  "On  the  Generation  of  Organizational  Architectures  Using 
Petri  Nets,”  LIDS-TH-1630,  S.M.  Thesis,  Laboratory  for  Information  and 
decision  Systems,  MIT,  Cambridge,  MA  December  1986. 

6.  J.  Kyratzoglou,  "Computer-Aided  Design  for  Petri  Net3,"  LIDS-TH-1694, 
M.E.  Thesis,  Laboratory  for  Information  and  Decision  Systems,  MIT, 
Cambridge,  MA  September  1987. 

5 .2  Technical  Papers 

1.  P.  Remy,  A.  H.  Levis,  and  Y.-Y.  Jin,  "Delays  in  Acyclical  Distributed 
Decisionmaking  Organizations,"  LIDS-P-1528,  Laboratory  for  Information 
and  Decision  Systems,  MIT,  January  1986,  also  in  Proc.  10th  World 
Congress  of  the  International  Federation  of  / utomatic  Control,  Munich, 
FRG,  July  1987'  revised  version  to  appear  in  Automatica,  1987. 

2.  A.  H.  Levis,  "Modeling  the  Measuring  Effectiveness  of  C*  Systems,"  LIDS- 
P-1608,  Laboratory  for  Information  and  Decision  Systems,  MIT,  September 

1986.  Prop,  Seventh  Annual  AFCEA  European  Symposium,  Brussels,  Belgium, 
October  1986. 

3.  M.  Athans,  "Command-and-Control  Theory:  A  Challenge  to  Control 

Science,"  LIDS-P-1584,  Laboratory  for  Information  and  Decision  Systems, 
MIT,  September  1986;  also  IEEE  Transactions  on  Automatic  Control,  Vol. 
AC-32.  No.  4,  April  1987. 

4.  P.  A.  Remy  and  A.  H.  Levis,  "On  the  Generation  of  Organizational 

Architectures  Using  Petri  Nets,"  LIDS-P-1634,  Laboratory  for  Information 
and  Decision  Systems,  MIT,  January  1987,  also  in  Proc .  Eighth  European 
Workshop  on  Applications  and  Theory  of  Petri  Net3,  Zaragoza,  Spain,  June 
24-27,  1987. 

5.  H.  P.  Hillion  and  A.  H.  Levis,  "Timed  Event-Graph  and  Performance 

Evaluation  of  Syustems,"  LIDS-P-1639,  Laboratory  for  Information  and 
Decision  Systems,  MIT,  January  1987,  also  in  Proc .  Eighth  European 
Workshop  on  Applications  and  Theory  of  Petri  Nets,  Zaragoza,  Spain,  June 
24-27,  1987. 

6.  A,  H.  Levis  and  M.  Athans,  "The  Quest  for  a  C*  Theory:  Dreams  and 

Realities,"  LIDS-P-1691,  Laboratory  for  Information  and  Decision 
Systems,  MIT,  August  1987,  to  appear  in  Proc.  1987  Symposium  on  C* 
Research,  National  Defense  University,  Fort  McNair,  Washington  DC,  June 

1987. 

6.  H.  P.  Hillion  and  A.  H.  Levis,  "Performance  Evaluation  of  Decisionmaking 
Organizations,"  LIDS-P-1683,  Laboratory  for  Information  and  Decision 
Systems,  MIT,  July  1987,  also  to  appear  in  Proc.  1987  Symposium  on  C* 
Research,  National  Defense  University,  Fort  McNair,  Washington  DC,  June 
1987. 


A.C.  Louvet,  J.  T.  Casey,  and  A.  H.  Levis,  "Experimental  Investigation 
of  the  Bounded  Rationality  Constraint,"  LIDS-P-1680,  Laboratory  for 
Informaion  and  Decision  Systems,  MIT,  July  1987,  also  to  appear  in  Proc . 
1987  Symposium  on  C*  Research,  National  Defense  University,  Fort  McNair, 
Washington  DC,  June  1987. 

S.  T.  Weingaertner  and  A.  H.  Levis,  "Evaluation  of  Decision  Aiding  in 
Submarine  Emergency  Decisionmaking,"  LIDS-P-1688,  Laboratopry  for 
Information  and  Decision  Systems,  MIT,  August  1987,  also  to  appear  in 
Proc.  1987  Symposium  on  C 1  Research,  National  Defense  University,  Fort 
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P.  J.  F.  Martin  and  A.  H.  Levis,  "Measures  of  Effectiveness  and  C* 
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on  Ca  Research,  National  Defense  University,  Fort  McNair,  Washington  DC, 
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ABSTRACT 


The  cognitive  limitation  of  human  decisionmakers  is  one  of  the 
determinants  of  organizational  performance.  A  basic  assumption  in  the 
analytical  methodology  for  organizational  design  is  that  bounded 
rationality  sets  an  upper  limit  on  the  amount  of  information  that  can  be 
processed.  When  this  rate  constraint  is  exceeded,  performance  should  be 
seriously  degraded.  An  experiment  that  represents  a  first  attempt  to 
quantify  the  level  of  cognitive  workload  associated  with  the  bounded 
rationality  constraint  of  humans  has  been  designed.  The  results  of  the 
experiment  indicate  that  a  threshold  level  can  be  established  and  used  in 
the  design  of  multi -person  experiments. 
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ABSTRACT 

The  cognitive  limitation  of  human  decisionmakers  is  one  of 
the  determinants  of  organizational  performance.  A  basic 
assumption  in  the  analytical  methodology  for  organizational 
design  is  that  bounded  rationality  sets  an  upper  limit  on  the 
amount  of  information  that  can  be  processed.  When  this  rate 
constraint  is  exceeded,  performance  should  be  seriously 
degraded.  An  experiment  that  represents  a  first  attempt  to 
quantify  the  level  of  cognitive  workload  associated  with  the 
bounded  rationality  constraint  of  humans  has  been  designed. 
The  results  of  the  experiment  indicate  that  a  threshold  level  can 
be  established  and  used  in  the  design  of  multi-person 
experiments. 


The  Workload  Surrogate 

Boettcher  and  Levis  (1982)  proposed  a  method  for 
modeling  the  cognitive  workload  of  individual  decision  makers. 
This  workload  surrogate,  based  on  N-dimensional  information 
theory,  has  three  key  features: 

( 1 )  it  is  objective :  it  does  not  require  decision  makers  to 
form  introspective  judgments  concerning  their 
workloads; 

(2)  it  is  comprehensive:  it  takes  into  account  not  only  the 
uncertainty  contained  in  the  input  information,  but 
also  the  uncertainty  associated  with  plausible  situation 
assessment  and  response  selection  algorithms; 

(3)  it  potentially  offers  inter-task  comparability  within 
the  task  context  specified  above." 


L  INTRODUCTION 


Individual  bounded  rationality  is  one  of  the  major 
determinants  of  performance  of  information  processing  and 
decision  making  organizations.  This  is  especially  true  for 
organizations  which  must  perform  under  severe  time  constraints 
(e.g.,  tactical  military  organizations).  Therefore,  in  designing 
such  organizations  and  the  command,  control,  and 
communications  svstems  which  support  them,  individual 
cognitive  workload1  is  of  critical  concern.  The  present  study 
represents  a  first  attempt  to  quantify  the  level  of  cognitive 
workload  associated  with  the  bounded  rationality  constraint  of 
humans.  This  will  be  done  within  the  context  of 
w'ell-structured,  time-constrained  decision  tasks  for  which  the 
decisionmaker  is  w'ell-trained. 


The  organization  of  this  paper  is  as  follows.  First,  an 
information  theoretic  surrogate  for  workload  is  described 
(Boettcher  and  Levis,  1982).  In  order  to  use  the  workload 
surrogate  in  predicting  organizational  performance  under  time 
constraint,  a  critical  assumption  about  the  nature  of  individual 
bounded  rauonality  is  required.  This  assumption  is  described  in 
terms  of  the  Yerkes-Dodson  law  relating  performance  and 
arousal.  Then  this  assumption  is  tested  in  the  context  of  a 
simplified  air  defense  task.  The  results  are  shown  to  provide 
support  for  the  existence  of  a  person-specific  bounded 
rationality  constraint.  Individual  differences  in  this  constraint 
are  described  and  prescriptive  implications  for  organizational 
design  are  discussed. 


*  This  work  was  carried  out  with  support  from  the  Office  of 
Naval  Research  under  contract  nos.  N00014-85-K-0329, 
N00014-84-K-0519,  and  from  the  Joint  Directors  of 
Laboratories  through  the  Office  of  Naval  Research  under 
contract  no.  N00014-85-0782. 


The  workload  surrogate  is  computed  using  n-dimensional 
information  theory.  Information  theory  is  build  upon  two 
primary'  quantities:  entropy  and  transmission.  Entropy  is  a 
measure  of  information  and  uncertainty:  given  a  variable  x 
belonging  to  the  alphabet  X,  the  entropy  of  x  is  : 

H(x)  =  -Z  p(x)  log  p(x)  (1) 

x 

Entropy  is  measured  in  bits  when  the  base  f  the  logarithm  is 
two. 

The  transmission  -  also  called  mutual  information  - 
between  variables  x  and  v.  elements  of  X  and  Y,  and  given  p(xi 
and  p(y),  and  p(xly)  is  defined  as  follows: 

T(x:y)  =  H(x)  -Hy(x)  (2) 

where 

Hy(x)  =  -L  pfy)  Z  p(xly)  log  p(xly)  (3) 

y  x 

The  expression  for  transmission  (2)  generalizes  for 
n-dimensions  to: 

T(x  j :xt : •  -.x p )  =  £  H(x;)  -H(xj,X2 . xn)  (4) 

i 

The  workload  surrogate,  denoted  by  G.  is  defined  as  being 
the  total  information  processing  activity  of  a  system  i.e.,  the 
sum  of  the  entropies  of  all  the  variables  in  the  system.  The 
Partition  Law  of  Information  (PLL  tConant,  1976'  ran  be  used 
to  decompose  the  total  activi'v  G  into  components  that 
characterize  what  may  happen  to  lr/ormation  as  it  is  processed 
by  a  system  .  For  a  system  with  input  van  a  ole  x.  N  internal 
variables  Wj  and  output  variable  y,  the  PLi  states: 

L  H(Wj)  =  T(x:y)  +  Ty(x:w1,w2....wjv;.])  (5) 

i  =  1  +T(w  j  :w2:...wjq_  j )  +  Hx(wj,W2,...Wjs-.],y) 
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This  equation  may  be  abbreviated  (keeping  the  same  order)  as: 

G  =  Gt  +  Gb  +  Gc  +  Gn  (6) 

where  G(  (called  throughput)  measures  the  amount  by  which  the 
input  and  output  are  related.  Gb  (called  blockage)  is  the  amount 
of  information  which  enters  the  system,  but  is  not  present  in  the 
output  or  blockage;  Gc  (or  coordination)  is  the  amount  by  which 
the  internal  variables  interact;  and  Gn  (or  noise)  is  the 
uncertainty  in  the  system  when  the  input  is  known. 

Bounded  Rationality  and  the  Yerkes-Dodson  Law 

The  bounded  rationality  constraint,  for  present  purposes, 
refers  to  a  hypothesized  characteristic  of  a  particular  region  of 
the  function  relating  decision  making  perfomance  to  cognitive 
workload,  where  workload  is  calculated  using  the  workload 
surrogate.  Considerable  experimental  psychological  work  has 
examined  the  influence  of  arousal  on  performance  in  various 
types  of  tasks  (Kahneman,1973).  Arousal  is,  in  turn, 
influenced  by  a  variety  of  factors,  including  cognitive  workload. 
The  commonly  observed  relation  between  performance  and 
arousal,  called  the  Yerkes-Dodson  curve  or  "law",  is  shown  in 
Figure  1.  This  relation  is  obtained  when  arousal  is  varied  over 
an  extremely  wide  range.  At  very  low  arousal,  performance  is 
low  due  to  boredom  and  vigilance  limitations.  At  very  high 
arousal,  performance  is  low  due  to  extreme  stress  and  sensory 
overload.  However,  in  a  well-designed  organization,  all 
decision  makers  should  be  operating  near  the  top  of  the  curve  at 
all  times.  Thus  the  central  region  of  the  curve  is  of  particular 
interest.  It  is  important  for  an  organizational  designer  to  know¬ 
how  much  cognitive  workload  (e.g.,  in  bits  of  information 
processed  per  unit  time)  the  organization  members  can  cope  with 
without  substantial  decrements  in  performance  due  to  overload. 
If  the  bounded  rationality  constraint  is  to  be  quantified  in  this 
way.  it  must  first  be  established  that  performance  does  indeed 
begin  to  drop  at  a  predictable  point  w-ith  increasing  workload. 
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Fig.  1  Relationship  between  the  Yerkes  -  Dodson  law  and  T* 
Workload,  Processing  Rate,  and  Interarrival  Time 


sequence  of  independent  tasks  that  have  interarrival  time  T. 
Performance  for  each  task  is  a  binary  variable,  taking  on  the 
value  1,  if  the  decision  is  accurate  and  timely,  and  0  otherwise. 
The  workload  experienced  by  the  decision  maker  can  be 
expressed  as: 

G  =  F  t';  t'<t,  (7) 

where  G  is  the  decision  maker's  workload  per  task,  F  is  the 
decision  maker's  processing  rate,  and  i'  is  the  portion  of  the 
interarrival  time  during  which  the  decision  maker  is  processing 

the  task.  If  t  is  more  than  ample,  various  tradeoffs  between  F 
and  t'  are  possible,  any  one  of  which  will  get  the  work  done 

within  the  allotted  time.  x.  However,  for  sufficiently  small 

values  of  x,  t'  will  approach  x,  and  the  decision  maker  must 
increase  F  in  order  to  maintain  G  and  thereby  avoid  a  decrease  in 
performance. 

The  Threshold  Hypothesis 

This  reasoning  leads  to  a  threshold  hypothesis  which  is  the 

focus  of  the  paper:  As  t  is  decreased,  a  point,  T* ,  will  be 
reached  beyond  which  further  increases  in  F  are  impossible.  As 
a  result,  performance  will  drop  substantially.  This  hypothesis  is 
an  underlying  assumption  in  the  organizational  design 
methodology  proposed  by  Levis  and  his  co-workers  (1984). 
Under  this  assumption,  the  bounded  rationality  constraint, 
Fmax,  can  be  expressed  as: 

^max  =  C’r  /  T*  (8) 

where  Fmax  is  the  ’.CDer  bound  on  the  decision  maker's  rate  of 
processing  in  bits  i  •t  unit  time,  Gr  is  the  w-orkload  (total 
information  theoretic  ,  ctivity  in  bits)  per  task  computed 
analytically  via  the  workload  surroga:e.  and  T*  is  the  interarrival 
time  threshold  below  which  performance  deteriorates 
substantially.  T*  must  be  measured  initially  experimentally. 
The  obtained  value  of  T*  depends,  of  course,  upon  the  structure 
of  the  task,  as  does  the  computation  of  Gr. 

If  a  T*  value  can  be  found  practically  for  an  individual 
performing  an  experimental  task,  then  the  individual's  bounded 
rationality  constraint  can  be  estimated  quantitatively  from  (2).  If 
this  constraint  shows  reasonable  stability  across  well  defined 
tasks,  then  it  is  of  interest  to  attempt  to  characterize  individual 
differences  in  the  bounded  rationality  constraint.  Thus  three  kev 
empirical  issues  must  be  addressed: 

(1)  Is  there  a  person-specific  threshold?  That  is,  for  most 
individuals,  is  performance  uniformly  high  whenever 
the  minimum  (or  "continuous  duty")  processing  rate 
required  by  the  task  is  less  than  some  person-specific 
critical  (Fmax)  value? 

(2)  Is  Fmax  robust  within  an  individual  to  manipulation  of 
task  parameters  unrelated  to  workload? 

(3)  What  are  the  characteristics  of  the  distribution  of 
F max  for  a  sample  of  individuals?  Uni-  or  multi¬ 
modal?  Normal  or  skewed?  Low  or  high  variance? 


Workload  can  be  manipulated  in  two  basic  ways:  by 
varvinc  task  compi.M'v  tamourn  of  processing  required)  or  bv 
varving  the  amount  of  time  available  for  doing  a  given,  well 
defined  task.  The  latter  method  was  used  in  the  present  work. 
Consider  a  situation  in  which  a  decision  maker  is  performing  a 


If  workload  per  task,  Gr,  is  assumed  constant  as  certain 
task  (or  person)  parameters  are  varied,  then  Fmax  can  be 
constant  only  if  T*  is  found  to  be  constant.  Thus,  these 
questions  can  be  answered  directly  in  terms  of  T*  rather  than 
Fmax-  This  simplification  eliminates  the  need  to  compute  Gr 
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coPnTtaan!yr°r  “m  !?Sk  varian' or  Perso"-  The  assumption  of 
constant  Gr  will  be  met  whenever  a  single  information 

52?r«  algorithm  (strategy)  is  used  consistentiv,  or  the 

SmT  manne^Tf15  aS  3  funCtion  of  1  in  essentially  the 

same  manner.  The  resulting  prescription  for  experimental 

design  is  thai  tasks  should  be  constructed  so  as  to  limit  possible 
algonthmic  vanability,  both  within  and  between  sub™^ 


1L  EXPERIMENTAL  METHOD 

The  experiment  involved  q  highly  simplified  tactical  air 
defense  task  using  an  IBM  PC.  The  basic  screen  display  is 
shown  in  Figure  2.  The  large  circle  represents  a  radar  screen. 
On  each  of  a  series  of  tnals,  either  four  or  seven  incoming 
threats  were  present.  Two  pieces  of  information  were  provided 
concerning  each  threat:  relative  speed  and  relative  distance. 
The  information  for  each  threat  was  presented  as  a  ratio  of  two 
two-digit  integers4.  The  distance  was  the  numerator  and  the 
speed  the  denominator.  All  threats  were  assumed  to  be 
converging  on  the  center  of  the  screen. 


Fig.  2  The  screen  display  used  in  the  experiment 


The  physical  distance  of  each  ratio  from  the  center  was 
proportional  to  its  numeric  distance.  However,  in  order  to 
restrict  strategic  variability,  subjects  were  instructed  to  attend 
only  to  the  numeric  information.  This  restriction  is  important 
because  Greitzer  and  Hershman  (1984)  showed  that  an 
experienced  Air  Intercept  Controller  tended  to  use  physical 
distance  information  only  (and  not  speed  information.)  in 
determining  which  of  a  number  of  incoming  threats  to  prosecute 
First.  This  simplified  strategy  was  labelled  the  range  strate°v. 
The  operator  was,  however,  able  to  use  both  range  and  speed 
information  —  the  threat  strategy  —  when  instructed  explicitly  to 
do  so.  The  threat  strategy,  if  executed  in  a  timely  way,  is  of 
course  more  effective  than  the  simpler  range  strategy. 

The  ratio  chosen  as  smallest  was  retained  on  the  radar 
screen  and  the  other  was  replaced  with  one  of  the  remaining 
ratios.  This  procedure  was  repeated  until  all  ratios  had  been 
examined.  Row(s)  of  small  rectangles  to  the  left  of  the  radar 
screen  indicated  the  total  number  of  threats  for  the  current  trial 
and  the  number  yet  to  be  examined  (see  Figure  2).  Each  time  a 
new  ratio  appeared  on  the  radar  screen,  one  of  the  rectangles 
disappeared.  ~ 

Performance  feedback  was  provided  at  the  end  of  each  tnal 
for  which  the  subject  finished  the  comparisons  within  the 
allotted  time.  In  this  case,  only  one  ratio  remained  on  the  screen 
at  the  end  of  the  trial.  If  this  ratio  was  in  fact  the  smallest,  it 
flashed  several  times  to  indicate  a  correct  response.  If  this 
ratio  was  not  the  smallest,  a  low-pitched  tone  signalled  the  error. 
This  tone  (which  subjects  reported  to  be  particularly  obnoxious) 
was  used  to  reduce  strategic  variability  by  biasing  subjects 
against  guessing. 

Manipulation  of  Intcrarrival  Time 

The  amount  of  time  allotted  for  each  trial  was  shown  by  a 
fixed  clock  hand  (see  Figure  2).  A  moving  second  hand 
(running  clockwise  from  12  o’clock)  indicated  elapsed  time 
within  a  trial.  A  1.5  sec.  pause  prior  to  the  start  of  each  trial 
allowed  subjects  to  see  how  much  time  was  allotted.  The  fixed 
hand  flashed  during  this  interval. 


The  subject's  task  was  to  select  the  threat  w'hich  would 
arrive  first  in  the  absence  of  interception.  Since  the  ratio 
represents  the  time  it  will  take  for  the  threat  to  reach  the  center  of 
the  screen,  the  task  can  be  interpreted  as  one  of  selecting  the 
minimum  ratio.  In  order  to  limit  strategic  variability,  two 
restrictions  were  imposed.  First,  ratios  were  displayed  in  pairs; 
only  two  ratios  were  visible  at  a  time.  This  procedure  eliminated 
variation  in  the  order  of  information  acquisition.  Second,  to 
reduce  the  incidence  of  responding  based  on  incomplete 
information,  a  final  response  was  permitted  only  after  all  of  the 
four  or  seven  ratios  had  been  displayed. 

Ratios  could  appear  only  on  the  vertical  or  ho:  .zontal 
diameter  of  the  radar  screen.  Thus  ratios  appeared  in  one  of 
four  regions:  left,  right,  above,  or  below  the  center.  Each  ratio 
was  ranjomlv  assigned  to  one  of  these  four  regions,  subject  to 
the  constraint  that  no  two  ratios  appear  in  the  same  region  at  the 
same  time.  For  each  pair  of  ratios,  the  subject  indicated  his  or 
her  choice  by  pressing  one  of  four  arrow  keys  corresponding  to 
the  direction  of  the  ratio  from  the  radar  screen's  center,  the 
arrow  keys  were  located  on  the  numeric  keypad  of  the  keyboard 
and  were  arranged  isomorphicallv  with  the  four  regions  of  the 
radar  screen. 


Time  per  trial  was  varied  in  alternating  descending  and 
ascending  series.  Twice  as  much  time  was  allotted  for  seven  as 
for  four  threat  trials,  because  the  number  of  comparisons  was 
double  (six  versus  three).  In  order  to  retain  comparability 
between  the  four  and  seven  threat  conditions,  t  is  defined  as  time 
per  comparison,  rather  than  as  trial  interarrival  time,  t  was 
varied  from  0.75  sec.  to  3.5  sec.  in  0.25  sec.  increments  for 
both  conditions.  Thus  12  values  of  t  were  used,  t  ranged  from 
2.25  to  10.5  sec.  for  four  threats  and  from  4.5  to  2l%ec  for 
seven  threats. 


was  constructed  to  minimize  the  influence  on 
^?^,anCe  of  ume  squired  for  non-cognitive  (i.e„  perceptual 
and  motor  activity).  Even  the  minimum  t  of  0.7^  sec  allows 
amp  e  time  for  eye  movements,  perception,  and  motor  response 
lhe  limiting  factor  in  response  time  then  is  the  rate  of  cognitive 
actlvIt>’-  Fmax- 


Organization  of  Trials 


i  «  J  01  treats  was  constant  within  blocks  of  24 
tnals  A  block  of  tnals  consisted  of  a  descending  series  over  the 

thm,tiUwS  °{,h  foI‘owcd  ,bty  311  ascending  series.  The  number  of 
threats  was  then  changed  for  the  subsequent  block.  There  was  a 

“T,  SCCi  paUtC  Ktwecn  blocks,  dunng  which  time  the  large 

mriS  ^t0the  efj°fthue  radar  screen  <see  FiSure  2)  flashed  to 
indicate  the  impending  change  in  number  of  threats 
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For  each  subject,  the  full  experiment  consisted  of  24 
iterations  (12  descending  and  12  ascending)  over  values  of  t  for 
each  number  of  threats.  The  total  duration  was  approximately 
2.5  hours.  Eight  iterations  were  completed  in  each  of  three 
sessions.  Subjects  typically  participated  in  no  more  than  one 
session  per  day.  Prior  to  each  experimental  session,  subjects 
were  given  a  brief  (three  to  five  minute)  "warmup"  period 
during  which  no  data  were  recorded. 

Practice  Session 

Subjects  received  a  30  minute  practice  session  prior  to  the 
actual  experiment.  This  session  consisted  of  six  iterations  over  t 
for  each  number  of  threats.  For  the  practice  session,  t  was 
varied  from  1  to  5  sec.  per  comparison  in  0.5  sec.  increments. 
Informal  discussion  with  subjects  indicated  that  most  felt  their 
performance  would  not  improve  substantially  with  additional 
practice.  The  practice  data  were  not  analyzed. 

Subjects 

Twenty-one  subjects  participated  in  the  experiment.  The 
majority  of  subjects  were  present  or  former  MIT  students.  They 
were  paid  a  flat  rate  of  approximately  $6  per  session. 

III.  RESULTS  AND  DISCUSSION 
Data  Reduction  and  Transformation 

Each  subject  received  a  binary  performance  score  for  each 
trial.  A  trial  was  scored  one,  if  the  three  or  six  comparisons 
were  completed  w'ithin  the  allotted  time  and  the  correct  threat 
(minimum  ratio)  was  selected.  Otherwise,  the  trial  was  scored 
zero.  Figure  3  shows  the  raw  data  matnx  of  binary  scores  for 
one  iteration  over  values  of  t  --  that  is,  for  one  replication.  The 
full  data  matrix  was  four-dimensional,  consisting  of  21  subjects 
by  12  values  of  t  by  2  sets  of  threats  by  24  replications.  These 
binary  scores  were  converted  into  proportions  by  summing  over 
replications  and  dividing  by  24.  This  yielded  a  three 
dimensional  matnx  of  proportions,  consisting  of  21  subjects  by 
12  values  of  t  by  2  sets  of  threats. 


Proportion  data  violate  the  homogeneity  of  error  variance 
assumption  required  for  regression  and  curve-fitting.  In  order 
to  equate  these  error  variances,  the  proportion  data  were 
transformed  via  the  formula: 

(sin  1  /proportion  )/  1.57  (9) 

where  the  denominator  is  a  scaling  constant  The  general  effect 
of  this  transformation  is  to  increase  slightly  small  proportions, 
while  decreasing  slightly  large  proportions.  All  analyses 
reported  herein  are  based  on  the  transformed  proportion  data. 

The  threshold  hypothesis  will  be  evaluated  in  terms  of  T* 
w  ith  respect  to  the  three  questions  discussed  above:  Is  there  a 
person-specific  threshold  in  performance  as  a  function  of  the 
required  processing  rate?  Is  this  threshold  robust  to  minor  task 
changes  unrelated  to  workload  (i.e.,  changes  in  number  of 
threats  with  time  per  threat  held  constant)0  How  can  the 
distribution  of  individuals'  thresholds  be  characterized0 

Is  There  a  Perso;  Specific  Threshold  Fmajk  ? 

General  characteristics  of  curves:  For  each  subject,  two 
data  curves  were  plotted,  one  for  four  threats  and  one  for  -.even 
threats.  Figure  4a-c  shows  performance  as  a  function  of 
interamval  time  for  three  subjects.  These  curves  were  selected 


Values  of  T 


as  examples  of  the  strongest  (a),  typical  (b),  and  weakest  (c) 
degrees  of  support  for  the  threshold  hypothesis  contained  in  the 
set  of  42  (21  subjects  for  two  sets  of  threats  each)  curves 
obtained  from  the  experiment.  Visual  inspection  of  the  entire  set 
of  curves  revealed  the  following  general  characteristics: 

(1)  They  do  not  have  the  Yerkes-Dodson  concave 
shape.  This  indicates  that  the  experiment  succeeded 
in  tapping  into  the  moderate-to-high  arousal  portion 
of  the  Yerkes-Dodson  curve  (see  Figure  1),  rather 
than  the  "vigilance"  portion. 

(2)  Most  curves  are  nearly  flat  (zero  slope)  for  large 
values  of  x. 

(3)  They  have  positive  slopes  for  smaller  values  of  i. 

(4)  Some  "leveling-  off "  to  very  small  positive  slopes  for 
the  smallest  x  values. 

These  characteristics  suggest  that  some  type  of  growth  curve, 
also  called  S"  curve,  would  be  appropriate  for  summarizing  the 
data. 
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Fig.  4  a-c  Performamce  as  a  function  of  interarrival  time 
for  three  subjects. 


The  use  of  a  growth  curve  can  be  justified  not  only  by 
plots  of  the  experimental  data,  but  also  by  the  physical 
behaviour  that  underlies  the  growth  curves.  Growth  curves  are 
characterized  by  their  S  shape:  the  growth  starts  slowly 
(characterized  by  a  nearly  flat  curve  segment),  then  the  growth 
increases  rapidly  (steep  slope)  and  finally  levels  off  to  an 
optimum  or  saturation  level  (the  curve  flattens  again).  Recall 
that  the  purpose  of  the  experiment  is  to  investigate  whether  there 
is  a  bounded  rationality  constraint  i.e.,  whether  well  trained 
decisionmakers  under  time  pressure  will  perform  near  optimum 
until  they  are  beyond  the  bounded  rationality  constraint  when 
performance  will  decrease  rapidly;  as  the  time  pressure  further 
increases  their  performance  will  quickly  fall  to  an  almost  null 
level.  Considering  the  hypothesis,  a  growth  curve  seems  most 
appropriate,  since  it  characterizes  patterns  where  quantities 
increase  from  near  zero  to  the  optimum  level  very  rapidly. 

For  the  purpose  of  this  experiment,  the  most  appropriate 
curve  of  the  family  is  the  Gompertzt  curve  which  has  the 
characteristic  of  not  being  symmetric  about  the  inflection  point. 
This  is  a  relevant  property,  since  one  can  not  predict  that 
performance  will  decrease  in  a  symmetric  way  after  the  subject 
is  working  beyond  the  bounded  rationality  constraint.  Also,  it 
was  almost  impossible  to  get  a  significant  number  of  data  points 
near  null  performance,  since  the  time  could  not  be  decreased 
indefinitely:  poor  performance  had  to  be  caused  by  the 
incapacity  to  process  mentally  the  task  and  not  by  physical 
limitations  such  as  time  needed  to  press  the  necessary  keys. 

The  Gompertz  curve  has  three  degrees  of  freedom  and  is 
given  by  (Martino,  1972): 


where  J  is  performance  expressed  as  a  proportion. 

Gompertz  curve  parameters  were  estimated  independently 
for  each  of  the  42  data  sets.  Figures  4  a-c  also  show  the 
Gompertz  fit  superimposed  on  the  observed  data  .  The 
Gompertz  fit  was  quite  good  (0.93  £  r  <  0.99)  in  every  case. 
Thus,  in  effect,  the  Gompertz  curves  provide  a  concise 
mathematical  description  of  the  data.  Table  1  summarizes  the 
degree  of  fit  of  the  data  to  the  S  curves  versus  linear  regression. 


Table  1 .  Summary  of  r:  values  for  S  vs.  linear  functions 


Mean 

Std.  dev. 

Min. 

Max. 

s 

0.98 

0.01 

0.93 

0.99 

Linear 

0.75 

0.15 

0.25 

0.94 

Estimation  of  T*:  For  each  subject,  two  T*  values  were 
estimated  (one  for  each  number  of  threats)  from  the  appropriate 
S  curve.  As  illlustrated  in  Figure  5,  T*  was  taken  as  the  t  value 
corresponding  to  the  intersection  of  two  lines  tangent  to  the  S 
curve.  One  of  the  lines  was  tangent  to  the  curve's  asymptote  as 
t  ->  oo  while  the  other  was  tangent  at  the  inflection  point.  This 
method  for  estimating  T*  was  chosen  because  it  is  conservative 
in  the  sense  that  performance  is  not  degraded  seriously,  even  for 
values  of  t  somewhat  smaller  than  T*.  This  conservativeness 
results  from  the  extrapolation  to  asymptotic  performance 
(which,  according  to  the  Yerkes-Dodson  law,  is  never  reached) 
in  defining  the  upper  tangent  line.  Figure  5  shows  the  tangen: 
lines  and  resulting  T*  value  for  the  same  S  curve  as  shown  in 
Figure  4a. 


Inierarrival  Time  (sec) 


Fig.  5  Estimate  of  T*  value  using  S  curve  approximation 

The  obtained  T*  values  are  summarized  in  Table  2.  The 
mean  value  of  T*  over  subjects  and  numbers  of  threats  was  2.2 1 
sec.  (standard  deviation:  0.70).  Confidence  in  the  method  for 
estimating  T*  is  increased  by  the  finding  that  for  both  threat 
conditions  the  mean  value  of  T*  over  subjects  was  roughly 
equal  (i.e.,  within  0.05  sec.)  to  the  T*  obtained  from  the  curve 
of  the  mean  over  subjects. 


Table  2.  Summary  of  T*  values  (in  seconds)  for 
4  and  7  threats 


Mean 

Sid.  dev. 

Min. 

Max. 

4  threats 

2.19 

0.77 

0.96 

4.46 

7  threats 

2.23 

0.65 

1.26 

3.68 

Two  subjects  had  T*  values  greater  than  the  maximum  t  of 
3.5  sec.  (up  to  4.46  sec.).  These  subjects'  curves  were  unique 
in  that  they  had  substantial  positive  slopes  even  at  the  maximum 
t.  Had  the  maximum  t  been  increased  for  these  subjects,  a 
near-zero  slope  region  would  presumably  have  been 
encountered. 


The  data  clearly  support  the  existence  of  a  threshold,  T*. 
for  each  of  the  21  subjects  tested.  This  result  opens  the  door  to 
information  theoretic  quantification  of  the  bounded  rationality 
constraint,  Fmax,  for  each  subject  via  Equation  (2).  The  only 
additional  information  needed  to  solve  for  Fmax  would  be  an 
estimate  of  the  workload,  Gr,  computed  analytically  using  the 
workload  surrogate. 

Is  the  Threshold  Robust  to  Task  Changes  Unrelated  to 
Workload? 

Robustness  of  the  threshold  to  changes  in  the  number  of 
threats  would  help  to  establish  that,  to  some  degree,  the 
bounded  rationality  constraint  is  stable  across  tasks.  If, 
however,  instability  were  found  for  such  a  minor  task  change, 
there  would  be  no  need  tc  go  funher.  In  addition,  the  effect  of 
manipulating  number  of  threats  is  of  some  intrinsic  interest, 
because  of  implications  for  how  subjects  manage  their  time. 

Effective  time  management  is  more  critical  for  seven  than 
for  four  threats,  while  "overhead"  or  "start-up"  time  is  more 
critical  for  four  threats  than  for  seven.  Subjects  knew  before  the 
start  of  each  trial  how  much  time  was  allocated  for  the  trial.  Pan 
of  the  subject's  task  was  to  budget  the  available  time  over  the 
three  or  six  comparisons  so  that  all  comparisons  could  be 
completed  and  full  use  made  of  the  available  time.  The  criticality 
of  accurate  budgeting  can  be  seen  from  Equation  (11). 

Response  Time  =  n  t'  +  b,  (11) 

where  n  is  the  number  of  companions  (three  or  six),  t'  is  the 
amount  of  time  the  subject  allocates  for  each  comparison,  and  b 
is  the  overhead,  startup,  or  initialization  time  for  a  trial.  The 
value  of  b  is  independent  of  n.  According  to  this  model,  the 
subject  must  choose  t'  so  that  the  resulting  response  time  is  less 

than  or  equal  to  n  x.  Clearly,  with  increasing  n,  the  detrimental 
effect  of  setting  t'  non-optimally  increases  relative  to  the 
detrimental  effect  of  the  fixed  overhead,  b. 

Comparison  of  T*  for  4  threats  and  T*  for  7  threats:  As 
Table  2  suggests,  no  systematic  differences  were  found  in  T*  as 
a  function  of  the  number  of  threats.  The  mean  over  subjects  for 
T*  (4  threats)  did  not  differ  significantly  from  that  for  T*  (7 
threats),  t(  1 9)  =  0.28,  p>0.05.  Twelve  of  21  subjects  had 
T*(7)  >  T*(4).  This  proportion  is  not  significantly  different 
from  0.5.  Moreover,  no  subject  performed  significantly  better 
for  one  number  of  threats  than  for  the  other. 


The  absence  of  systematic  differences  in  T*  due  to  the 
number  of  threats  manipulation,  provides  modest  evidence  that 
T*,  and  therefore  Fmax,  may  be  a  stable  individual  characteristic 
within  the  class  of  well-structured,  time-constrained  information 
processing  and  decisionmaking  tasks.  Th:s  stability  suggests 
that  it  may  not  be  necessary  to  measure  a  det  ision  maker's  Fmax 
value  for  every'  type  of  task  the  decision  maker  may  have  to 
perform.  Instead,  the  decision  maker's  Fmax  value  could  be 
measured  using  a  prototypic  "calibration"  task.  The  value 
obtained  from  this  prototypic  task  could  be  safely  assumed  io 
apply  to  a  substantial  range  of  structurally  similar  tasks. 

Distribution  of  Individual  Differences  in  T* 

The  case  for  the  existence  and  stability  of  the  bounded 
rationality  constraint,  Fmax,  within  individuals  is  clear.  T*  and, 
therefore,  Fmax  are  stable  as  the  number  of  threats  is  varied  from 
four  to  seven.  In  addition,  these  results  provide  indirect 
evidence  for  the  stability  of  Fmax  over  time,  since  each  subject 
was  tested  on  three  or  four  different  days.  (A  "composite" 
curve  resulting  from  wide  day  to  day  fluctuations  in  the  bounded 
rationality  constraint  would  not  likely  reveal  a  clear  threshold.) 
However,  despite  this  intraperson  stability,  one  would  not 
expect  interperson  stability.  Indeed,  a  finding  that  T*  is 
constant  across  people  (even  in  a  sample  of  MIT  students) 
would  be  disturbingly  counterintuitive.  As  Table  2  suggests, 
there  is  substantial  variability  in  T*  across  individuals.  Figure  6 
shows  the  frequency  distribution  of  21  T*  values.  These  values 
were  obtained  by  averaging  each  subject's  T*(4)  and  T'(7) 
value:  each  value  is  the  T*  associated  to  one  subject.  This 
distribution  is  unimodal.  very  peaked,  and  has  mean  2.21  sec. 
and  standard  deviation  0.70  sec.  Moreover,  the  distribution  of 

individual  T*  values  can  be  characterized  as  normal  -  A  y~  test 
for  goodness  of  fit  revealed  non-significant  deviation  from 

normality:  Q2  =  5.65  <  y}{.95,2)  =  5.99. 


<1.34  1.34-1.92  1,92-2.5  2.5-3.07  3.C7> 

Time  Interval  (sec) 


Fig.  6  Distribution  of  T*  values. 


IV.  CONCLUSIONS 

The  assumption  in  the  organizational  design  methodology 
that  an  individual  decision  maker's  performance  will  be  adequate 
whenever  a  fixed  bounded  rationality  constraint  is  not  exceeded 
is  supported  by  the  present  results.  In  addition,  the  bounded 
rationality  constraint  appears  not  to  be  affected  bv  superficial 
task  variables  that  do  not  appreciably  change  workload.  Finally, 
across  individuals,  the  bounded  rationality  constraint  was  found 
to  be  normally  distributed. 


F(X)TNOTES 


This  finding  along  with  the  finding  that  Fmax  is  normally 
distributed  has  an  important  prescriptive  implication  for 
organizational  design.  In  an  organization  consisting  of  several 
decisionmakers,  tasks  must  be  allocated  so  that  no 
decisionmaker  is  overloaded.  The  knowledge  that  Fmax  is 
nomiallv  distributed  can  be  used  to  make  the  first  allocation  of 
tasks;  then  when  specific  individuals  are  assigned  10  the  tasks,  a 
further  fine  tuning  of  the  organization  can  be  done  by  the 
designer.  The  cognitive  workload  and  the  tempo  of  operations 
can  be  specified 'so  that  the  individual  organization  members 
operate  below,  but  near  their  threshold.  This  leads  the  way  for 
controlled  experiments  in  which  the  individual  workloads  can  be 
manipulated  to  exceed  the  bounded  rationality  constraint  and  the 
effect  on  the  organizational  performance  observed.  That  is,  with 
the  information  obtained  from  this  experiment,  it  is  now 
possible  to  calibrate  the  mathematical  model  of  distributed 
tactical  decisionmaking  organtzauons  and  determine  the  range  of 
parameters  over  which  experiments  should  be  carried  out. 

V.  REFERENCES 

Boettcher,  K.  L.,  and  A.  H.  Levis  (1982).  Modeling  the 
interacting  desisionmaker  with  bounded  rationality.  IEEE  Trans. 
Sys.  Man  Cybcrn.,  SMC- 12,  pp.  334-344. 

Conant,  R.  C.  (1976).  Laws  of  information  which  govern 
svstems.  IEEE  Trans.  S\s.  Man  Cvbcrn.,  SMC-6,  pp. 
240-255. 

Greitzer,  F.  L..  and  R.  L.  Hershman  (1984).  Modeling  decision 
making  strategies  in  simulated  AAW  operations.  Proc  7th 
MIT/ONR  Workshop  on  Systems.  LIDS-R-1437,  MIT, 
Cambridge,  MA.  pp.  145-150. 

Kahneman,  D.  (1973).  Attention  and  Effort.  Englewood  Cliffs, 
NJ:  Prentice  Hall. 

Levis,  A.  H.  (1984).  Information  processing  and 
decisionmaking  organizations:  A  mathematical  description. 
Large  Scale  Systems,  vol.  7,  pp.  151-163. 


Martino,  J.  P.  (1972).  Technological  Forecasting  for  Decision¬ 
making.  New  York,  NY:  Elsevier 


The  term  "workload"  will  be  used  throughout  to  refer 
specifically  to  cognitive  workload  as  opposed  to,  for  example, 
perceptual  or  manual  workload. 

•*) 

■  The  PLI  should  be  a  very  useful  tool  when  designing  multi 
person  experiments  since  it  considers  different  aspects  of 
communication  within  an  organization.  The  PLI  could  help 
identify  the  variables  (or  characteristics)  of  the  organization 
which  are  of  interest  and  help  predict  how  the  total  workload 
and  performance  of  the  organization  will  be  affected  because  of 
changes  of  one  or  more  of  these  critical  \anables. 

^  The  experiment  was  run  on  a  Compaq  Deskpro  Model  2 
equipped  with  8087  math  coprocessor,  monochrome  graphics 
card  (640  X  200  pixels),  640K  of  memory,  and  monochrome 
monitor.  Programming  was  in  Turbo  Pascal  version  3.01  A. 
The  operating  system  was  MS-DOS  version  2.11.  It  was  also 
run  on  an  IBM  PC  AT  w'ith  the  80287  math  coprocessor  and 
with  640K  of  memory.  None  of  the  high  resolution  graphics 
capabilities  if  the  AT  were  used  so  that  the  experiment  be 
portable  to  a  wide  variety  of  PC  compatible  machines. 

4  Speeds  and  distances  were  selected  subject  to  the  following 
constraints:  (1)  greater  than  10  and  less  than  98,  (2)  no  multiples 
of  10.  Each  speed  and  distance  combination  was  screened  and 
rejected  if  the  resulting  ratio  was:  (1)  a  whole  number,  (2)  no 
speed  value  be  used  more  than  once  per  trial;  and  (3)  no 
multiples  of  10  be  used.  Distances  were  selected  independently 
of  speeds,  but  subject  to  the  same  constraints.  For  each  trial,  all 
ratios  were  either  greater  than  or  less  than  one.  This  restriction 
was  included  because  pilot  work  had  shown  that  decisions  ratios 
on  opposite  sides  of  one  w'ere  trivially  easy,  regardless  of 
interarrival  times.  The  greater-than-one  /  less-than-one 
determination  was  made  randomly  for  each  trial.  Candidate 
ratios  were  screened  against  the  following  criteria:  (1)  each 
possible  pair  of  ratios  within  a  trial  must  differ  by  no  less  than 
0.05  and  by  no  more  than  0.9,  w-hile.in  the  greater  than  one 
condition,  the  minimum  allowable  ratio  was  1.2;  (?i  ratios 
yielding  whole  number  quotients  W'ere  not  allowed.  If  a 
candidate  ratio  failed  on  any  criterion,  a  new  ratio  was  generated 
and  the  process  repeated  until  a  complete  set  of  4  or  7 
compatible  ratios  had  been  obtained. 


